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ABSTRACT 


Iterative  algorithms  for  signal  reconstruction  from  partial  time-  and 
frequency-domain  knowledge  have  proven  useful  In  a  number  of  application 

areas.  In  this  report,  a  general  convergence  proof,  applicable  to  one  class 
of  such  Iterative  reconstruction  algorithms,  is  presented.  The  proof  relies 
on  the  concept  of  a  nonexpans lve  mapping  in  both  the  time  and  frequency 
domains . 

Two  examples  studied  In  detail  are  tlmellmlted  extrapolation  (equ¬ 
ivalently,  bandllmlted  extrapolation)  and  phase-only  slgpal  reconstruction. 
The  proof  of  convergence  for  the  phase-only  Iteration  1b  a  new  result  which 
illustrates  this  method  of  proof.  The  generality  of  the  approach  allows 
the  incorporation  of  nonlinear  constraints  such  as  time-  (or  space-)  domain 
positivity  or  minimum  and  maximum  value  constraints.  Finally,  the  under¬ 
relaxed  form  of  these  iterations  is  also  shown  to  converge  when  the  solution 
Is  not  guaranteed  to  be  unique. 
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1.0  Introduction 

Recently,  considerable  attention  has  been  focused  on  a  class  of  Iterative 
signal  reconstruction  algorithms  that  assume  partial  knowledge  of  the  signal 
In  both  the  time  and  frequency  domains.  Perhaps  the  most  widely  known  algor¬ 
ithm  of  this  type  Is  Gerchberg's  algorithm  [1]  for  bandllmited  extrapolation, 
which  has  been  considered  by  several  authors  Including  Papoulls  [2], 

Cadzow  [3],  and  Youla  [4].  More  recently,  Quatleri  and  Oppenhelm  [5]  and 
Hayes  et.  al  [6]  have  Investigated  iterative  procedures  for  reconstructing 
a  signal  from  the  phase  of  its  Fourier  transform.  A  related  problem  Involves 
reconstruction  from  the  magnitude  of  the  Fourier  transform  [5,7,8]. 

The  conditions  under  which  such  signal  reconstruction  problems  have  a 
unique  answer  are  known.  Often  these  solutions  are  closed  form  expressions 
In  terms  of  the  given  partial  knowledge,  but  they  still  may  be  computationally 
intractable.  Thus,  Iterative  solutions  have  been  proposed  to  generate  the 
reconstruction. 

In  this  paper,  we  Investigate  the  convergence  of  a  particular  set  of 
iterative  signal  reconstruction  algorithms.  These  iterative  solutions 
involve  repeated  transformation  between  the  time  and  frequency  domains  where, 
in  each  domain,  the  known  information  about  the  signal  is  incorporated  into 
the  current  estimate  of  the  desired  signal.  Although  our  discussion  centers 
on  two  specific  examples,  tlmelimlted  extrapolation  (and  consequently, 
bandllmited  extrapolation)  and  phase-only  reconstruction,  our  approach  Is 
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general  and  may  be  applied  to  other  Iterative  algorithms  that  satisfy  the 
same  assumptions.  Since  the  convergence  of  the  iteration  for  bandlimited 
extrapolation  has  been  demonstrated  by  others  [2,3,4],  the  present  paper 
offers  an  alternative  approach  into  which  nonlinear  constraints,  such  as 
positivity  [8,9]  can  be  incorporated.  The  generality  of  our  approach  also 
yields  the  first  proof  of  convergence  for  the  phase-only  reconstruction 
problem.  Finally,  it  is  straightforward  to  generalize  our  convergence 
proofs  to  multi-dimensional  signals. 

He  begin  in  Section  2  with  a  brief  review  of  the  required  mathe¬ 
matical  notation  and  terminology  and  state  three  theorems  that  are 
relevant  to  our  discussion  of  convergence.  In  Section  3,  we  define  some 
specific  mappings  and  establish  the  nonexpanslve  property  of  these  mappings. 

In  Section  4,  we  apply  the  results  of  the  previous  sections  to  demonstrate 
the  convergence  of  the  iterative  solutions  to  the  time-limited  extrapolation 
and  phase-only  signal  reconstruction  problems.  Finally,  in  Section  5,  we 
difcuss  some  extensions  to  the  iterative  algorithms  presented  in  Section  4. 

2.0  Mathematical  Preliminaries 

In  this  section,  we  first  establish  some  notation  and  terminology  re¬ 
lated  to  mappings  from  one  metric  space  into  another*.  He  also  define  what 
is  meant  by  a  fixed  point  of  a  mapping  and  review  a  few  results  related  to  the 
* 

He  assume  that  the  reader  is  familiar  with  the  basic  concepts  and  termin¬ 
ology  of  metric  spaces.  A  detailed  treatment  of  the  material  presented  in 
this  section  may  be  found  in  [10,11]. 


2 


wp 


existence  and  uniqueness  of  fixed  points.  We  then  define  a  special  class 
of  mappings  which  are  referred  to  as  nonexpansive  mappings.  Finally,  three 
theorems  are  presented  which  address  the  existence  and  uniqueness  of  fixed 
points  and  the  convergence  of  iterative  solutions  for  finding  a  fixed  point 
of  a  mapping  . 

2.1  Metric  Spaces,  Mappings  and  Fixed  Points 

A  metric  space  consists  of  a  set  X  along  with  a  metric  or  distance 

function  d  defined  on  X.  Frequently,  we  will  simply  refer  to  X  as  a  metric 

space  and  assume  that  an  underlying  metric  d  has  been  defined  on  X.  Through- 

N 

out  most  of  this  paper,  we  will  limit  our  discussions  to  the  metric  space  R 
with  the  Euclidean  metric 


!N-1  j 

E  Ix(n)  -  y(n)]2  |  1/2 


(1) 


A  point  xeRN  is  an  N-dimensional  vector  but  we  will  also  refer  to  it  as  an 
N-polnt  sequence  x(n).  In  this  context,  we  consider  that  x(n)  is  defined  for 
all  n  with  x(n)  equal  to  zero  outside  the  interval  [0,N-1]. 

A  mapping  F  from  a  subspace  A  of  a  metric  space  X  into  X  will  be 
represented  notationally  as  FsACX+X.  If  the  image  of  A  under  F,  F(A),  is 
a  subset  of  A,  we  say  that  F  maps  A  into  itself.  A  fixed  point  of  a  mapping 
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F:AcX->-X  is  a  point  x*eA  which  is  invariant  under  F,  i.e.,  F(x*)“x*.  Since 
not  all  mappings  have  a  fixed  point  (e.g. ,  F:R-*-R  with  F(x)»x+1),  conditions 
for  the  existence  or  uniqueness  of  fixed  points  are  important  in  many 
practical  applications.  Whenever  it  is  desired  to  numerically  determine  a 
fixed  point  of  a  mapping  which  is  known  to  have  at  least  one  fixed  point, 
an  iterative  procedure  is  often  employed.  A  common  iterative  approach  based 
on  the  method  of  successive  approximation  is  defined  by 

*k+l  "  F(xk>  <2> 

where  is  the  kth  approximation  to  the  fixed  point  x*  and  Xq  is  some 
initial  estimate  of  x*.  Using  the  notation  Flt(x)»F(Fk-1(x)) ,  (2)  may  be 
expressed  as 

\  -  Fk(x0)  (3) 

Unfortunately,  this  iteration  need  not  converge  to  a  fixed  point  of  F  even 
if  the  fixed  point  is  known  to  be  unique.  For  example,  although  the  mapping 
F:ft+R  defined  by  F(x)»-x  has  a  unique  fixed  point,  x**0,  the  Iteration 
defined  by  (2)  will  not  converge  unless  Xq-O. 


In  order  to  guarantee  that  the  iteration  in  (2)  converges  to  a  unique 
fixed  point  of  F,  constraints  must  be  imposed  on  the  mapping  F  and  on  the 
underlying  metric  spaces  A  and  X.  Since  the  convergence  of  the  iteration  (2) 
to  a  unique  fixed  point  of  F  plays  a  central  role  in  this  paper,  several 
theorems  which  address  this  issue  of  convergence  are  presented  in  the 
following  section. 

2.2  Contractions  and  Nonexpansive  Mappings 

There  are  many  different  types  of  constraints  which  may  be  imposed  on 

a  mapping  F:ACX-*X  and  on  the  metric  spaces  A  and  X  to  insure  the  existence 

or  uniqueness  of  a  fixed  point  of  F  or  to  guarantee  the  convergence  of  the 

iteration  defined  in  (2).  Perhaps  the  most  familiar  set  of  constraints  is 

that  contained  in  the  Contraction  Mapping  Theorem.  This  and  two  other 

theorems  are  presented  here  in  a  general  form,  even  though  we  will  confine 

N 

our  subsequent  discussions  to  R  .  First,  we  define  what  is  meant  by  a 
contraction  mapping. 

Let  A  be  a  subset  of  a  metric  space  X  and  let  F  be  a  mapping  which  maps 
A  into  itself.  Then  F  is  said  to  be  a  contraction  mapping  if  there  is  a 
constant  a,  0  <  a  <  1,  such  that  for  all  x,yeA. 


d(Fx,Fy)  <  a  d(x,y) 


(4) 
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We  then  have  the  following 


THEOREM  1  [10,  p.  120]  (Contraction  Mapping  Theorem):  If  F 
is  a  contraction  mapping  on  a  closed  subset  A  of  a  complete* 
metric  space  X,  then  there  is  a  unique  fixed  point  x*eA. 

k 

Furthermore,  the  sequence  =  F  (x^)  converges  to  x*  for 
any  initial  point  x^eA  and 


d(xn,x*)  ~  f^a  d(xi»xo) 


(5) 


j 

? 

1 

i. 


Although  the  Contraction  Mapping  Theorem  is  useful  in  many  applications,  not 
all  iterations  which  converge  to  a  unique  fixed  point  are  characterized  by  a 
contraction  mapping. 

A  wider  class  of  mappings  results  if  we  allow  a  to  equal  one  in  the 
definition  of  a  contraction  mapping.  In  this  case,  the  mapping  F:AcX+X 
is  said  to  be  nonexpans ive  if 


d(Fx,Fy)  <  d(x,y)  (6) 

for  all  x,yeA.  Unlike  contractions,  nonexpansive  mappings  may  have  any  number 
of  fixed  points. 

*  N 

We  point  out  that  the  metric  space  R  is  complete. 
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The  mapping  F  is  said  to  be  strictly  nonexpansive  if  strict  inequality 
holds  in  (6)  whenever  xj*y.  Although  it  is  straightforward  to  show  that  a 
strictly  nonexpansive  mapping  has  at  most  one  fixed  point,  strict  non- 
expansiveness  is  not  sufficient  to  guarantee  that  a  fixed  point  exists. 
Nevertheless,  if  an  additional  constraint  is  imposed  on  the  image  of  A  under 
F,  strictly  nonexpansive  mappings  may  be  shown  to  have  a  unique  fixed  point. 
Specifically,  we  have  the  following  theorem  which  will  play  an  important  role 
in  Section  4. 

THEOREM  2  [10,  p.  404]:  Let  F:ACX-*-X  be  a  strictly  non¬ 
expansive  mapping  which  maps  a  subspace  A  of  a  complete 
metric  space  X  into  itself.  If  the  image  of  A  under  F  is 
compact*,  then  F  has  a  unique  fixed  point,  x*eA.  Further- 
more,  the  sequence  x^*=F  (x^)  converges  to  x*  for  any  xQeA. 

Note  that  the  nonexpansiveness  of  F  implies  that  F  is  continuous.  Therefore, 
compactness  of  F(A)  may  be  replaced  by  the  stronger  condition  that  A  be 
compact. 

Unfortunately,  Theorem  2  does  not  hold  if  the  nonexpansiveness  of  F  is 
not  strict.  Therefore,  the  following  theorem,  which  will  be  needed  in 
Section  5,  is  useful  since  F  is  required  only  to  be  nonexpansive. 

*  N 

A  subset  of  A  of  R  is  compact  if  and  only  if  it  is  closed  and  bounded. 


THEOREM  3  [10,  p.  404]:  If  F  is  nonexpansive  and  maps 
a  convex*  compact  subset  A  of  the  metric  space  into 

itself,  then  F  has  a  fixed  point  in  A.  Furthermore,  for 
any  coe(0,l)  and  x^eA,  the  sequence 


*k+i "  (1-a))xk  + 


(7) 


converges  to  a  fixed  point  of  F  in  A. 

(7)  is  often  referred  to  as  the  relaxed  form  of  the  iteration  given  by  (2)  and 
co  is  the  relaxation  parameter.  When,  in  particular,  cue (0,1)  (7)  represents 
the  under-relaxed  form  of  (2). 

It  should  be  pointed  out  that  Theorem  3  guarantees  the  existence  of  a 
fixed  point  in  A.  This  fixed  point,  however,  need  not  be  unique  as  illustra¬ 
ted  by  the  mapping  F:  [0,l]-*-[0,l]  defined  by  F(x)*x. 

3.0  Time  and  Frequency  Domain  Mappings 

Let  h(n)  be  a  sequence  of  length  N  which  has  an  N-point  Discrete 
Fourier  Transform  (DFT) ,  H(k).  When  expressed  in  polar  form,  H(k)  is  given 
in  terms  of  its  magnitude  and  phase  by 

H(k)  -  |H(k)|exp[j0h(k)]  (8) 


* 

Convexity  of  A  requires  that  if  x,yeA  and  ae[0,l],  then  (l-a)x+ny  e  A. 
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In  this  section,  we  show  that  two  mappings  which  Incorporate  partial  in¬ 
formation  about  h(n)  in  the  time  domain  or  about  H(k)  in  the  frequency 
domain  are  nonexpansive.  In  particular,  we  investigate  a  time  domain 
mapping  which  substitutes  known  values  of  h(n)  into  an  estimate  x(n)  of 
h(n)  for  certain  Indices  n.  Similarly,  in  the  frequency  domain,  we  examine 
mappings  which  either  substitute  0^(k)  or  incorporate  known  values  of  H(k) 
into  X(k).  Another  iterative  procedure  invokes  the  substitution  of  known 
values  of  jH(k)j  into  X(k)  [5,7,8],  but  these  mappings  do  not  have  a  non¬ 
expansive  property  and,  therefore,  do  not  lie  within  the  framework  of  this 
paper. 

3.1  Notation  and  Framework 

The  mapping  which  incorporates  known  values  of  an  N-polnt  sequence 
h(n)  into  an  arbitrary  sequence  x(n)  will  be  denoted  by  T  and  is  defined  by 


T[x(n)] 


x(n)  ntflT 

h(n)  nelT 


(9) 


where  IT  is  a  subset  of  the  interval  [0,N-1]  over  which  h(n)  is  known. 

Figure  1  illustrates  the  mapping  in  the  case  of  timellmiting. 

Likewise,  in  the  frequency  domain,  the  mapping  which  incorporates  known 

values  of  H(k)  into  X(k)  will  be  denoted  by  F  .  This  mapping  may  be 
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represented  as  F 
respectively  and 


g 


■W_1BW  where  W  and  W-1 


denote  the  OFT  and  IDFT  mappings 


B[X(k) ] 


X(k)  n^IB 

H(k)  nelfi 


(10) 


with  I  a  subset  of  [0,N-1]  over  which  H(k)  is  known.  Figure  2  illustrates 

O 

the  mapping  where  constant  magnitude  replacement  and  linear  phase  replacement 
are  made  in  a  low-frequency  region.  Finally,  the  mapping  which  replaces  the 
phase  of  X(k)  with  the  known  phase  of  H(k)  is  given  by  where 


$[X(k)]  -  |x(k)|exp[j0h(k)] 


(ID 


3.2  Nonexpanslve  Properties 


We  now  proceed  to  show  that  the  mappings  T,  F^  and  F^  defined  in 

Section  3.1  are  nonexpanslve.  To  show  that  T  in  (9)  is  nonexpanslve  in 

N  N 

the  metric  space  R  is  straightforward.  Specifically,  for  any  x,yeR  , 

d2(x,y)  -  £  lx(n)-y(n)]2  +  £  [x(n)-y(n)]2  (12) 

nelx  ntflT 
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Using  Che  triangle  inequality  for  vector  differences,  (16)  becomes 


N-l 

d2(X,Y)  >  £ 

k-0 


|X(k)|-|Y(k)|  2 


(17) 


Thus, 


d2(X,Y)  > 


(18) 


Therefore, 


d(X,Y)  >  d($X,«Y)  (19) 

with  equality  if  and  only  if  for  each  index  k,  0  (k)-0  (k) ,  or  |x(k)|«0, 

x  y 

or  | Y (k) | *0.  Thus,  as  was  the  case  for  F^,  since  $  is  nonexpansive  then  so 

is  F  : 

P 

d(x,y)  >  d(Fpx,Fpy)  (20) 

Finally,  we  note  that  the  composition  of  two  or  more  nonexpansive  mappings 
is  also  nonexpansive.  In  particular,  the  compositions  OTF  and  P-TF  are 
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nonexpansive.  A  discussion  of  these  mappings  is  the  subject  of  the  following 
section  where  we  present  sufficient  conditions  for  the  sequences  xic+xa>Gx)c 
and  Xj[+^»PXjt  to  converge  to  s  unique  fixed  point. 

4.0  Iterative  Solutions  to  Signal  Reconstruction  Problems 


In  this  section,  an  iterative  solution  (2) 
reconstruction  problems  is  examined.  The  first 
the  composite  mapping  G-TF^,  i.e.. 


for  two  specific  signal 
is  the  iteration  defined  by 


Vi  ■  Cxk 


(21) 


where  T  and  F^-W  *BW  are  defined  by  (9)  and  (10),  respectively.  The  resulting 
reconstruction  algorithm  is  identical  to  the  timellmlted  (bandlimited) 
extrapolation  procedure  described  by  Gerchberg  [1]  and  Papoulls  [2].  This 
algorithm  seeks  to  determine  the  entire  Fourier  transform  of  a  finite 
duration  signal  given  knowledge  of  the  spectrum  only  over  a  subset  of  the 
frequency  domain. 

The  second  Iteration  is  defined  by  the  composite  mapping  P»TFp,  i.e.. 


Vi  -  Pxk 


(22) 


IS 


where  T  and  F  -W  *4>W  are  defined  by  (9)  and  (11),  respectively.  This  itera- 
P 

tion  defines  the  phase-only  algorithm  for  reconstructing  a  finite  duration 
signal  from  the  phase  of  its  Fourier  transform  [5,13]. 

The  objective  of  this  section  is  to  show  that,  under  the  appropriate  set 
of  conditions,  both  of  these  iterations  converge  to  the  desired  sequence, 
h(n).  First,  we  establish  conditions  which  guarantee  the  uniqueness  of  the 
sequence  which  simultaneously  satisfies  the  constraints  imposed  by  the 


mappings  of  T  and  F  or  F  .  Under  these  conditions,  we  then  show  that  both 

g  p 

G  and  P  are  strictly  nonexpansive  and  map  a  compact  subset  of  RN  into  itself. 
Finally,  using  Theorem  2  in  Section  2.2,  we  show  that  the  sequences  (21)  and 


(22)  converge  to  the  desired  sequence,  h(n). 


4.1  Timellmited  Extrapolation  Iteration 


There  are  applications  such  as  diffraction-limited  imaging  for  which  it 
is  desirable  to  determine  the  Fourier  transform  of  a  finite  duration  signal 
when  only  a  segment  of  the  transform  is  known.  In  order  that  this  problem 
be  well  defined,  however,  we  need  to  establish  a  set  of  conditions  related 
to  the  uniqueness  of  the  solution.  Specifically,  the  following  theorem  can 
be  deduced  from  the  results  in  [12]: 

THEOREM  4 :  Let  h(n)  be  a  sequence  which  is  zero  outside 
the  interval  [0,M-1],  Then  h(n)  is  uniquely  specified  by 
M  samples  of  its  Fourier  transform  in  the  interval  [0,2tt). 


16 


In  particular,  we  assume  frequency  samples  are  derived  from  the  DFT, 
and  that  only  a  segment  of  the  corresponding  Fourier  transform  Is  known 
In  an  Interval  I  .  To  satisfy  the  sampling  requirement  of  Theorem  4,  the 

D 

DFT  then  must  be  sufficiently  long  so  that  M  samples  of  the  DFT  fall  within 

this  given  Interval.  If,  for  example,  the  known  segment  Is  low-pass  with 

cutoff  frequency  o^,  there  must  exist  M  DFT  samples  In  the  region 

[0,o>  ]u  I2ir-«  ,2tt), 
c  c 

For  any  sequence  which  satisfies  this  finite  duration  constraint, 
there  Is  a  solution  which  expresses  h(n)  in  terms  of  M  samples  of  Its  Fourier 
transform.  However,  since  this  solution  requires  an  MxM  matrix  inversion,  an 
Iterative  solution  may  be  preferable  when  M  is  large.  One  such  iterative 
solution  alternately  imposes  the  time  and  frequency  domain  constraints  at 
each  step  of  the  Iteration,  Mathematically,  this  iteration  is  expressed  as 


Vi  ■  °*k  ■  <TV*k  (23) 

where  F  is  defined  by  (10)  with  I„C[0,N-1]  consisting  of  at  least  M  points, 
g  a  - 

and  .where  T  is  the  mapping  (9)  with  1^  -  [M,N-1] : 


x(n)  0  <  n  <  M 


(24) 


T[x(n)] 


0 


M  <  n  <  N 


We  now  proceed  Co  show  that  the  sequence  X^(n)  in  (23)  converges  to  h(n) 

U 

for  any  x^eR  . 

Let  S  denote  the  closed  sphere  of  radius  p  about  h: 

P 


Sp  “  {xeRN  |  d(x,h)  <_  p) 


(25) 


Since  G  Is  nonexpansive  and  Gh“h,  then  G  maps  Sp  Into  Itself.  To  see  this, 

consider  a  point  xeS  ,  Then 

P 


d(Gx,h)  -  d(Gx,Gh)  <_  d(x,h)  <_  p 


(26) 


so  GxeSp  and  our  claim  follows.  We  note,  in  addition,  that  the  continuity 
of  G  implies  that  G(Sp)  is  compact. 

N  N 

Now  consider  the  mapping  GiSpC  R  -*R  and  recall  from  (14)  and  (15)  that 


d(Gx,Gy)  -  d(TF  x,TF  y)  <  d(F  x,F  y)  <  d(x,y) 

o  o  o  o 


(27) 
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We  shall  proceed  to  show  that  G  is,  In  fact,  strictly  nonexpanslve. 

Assume  to  the  contrary  that  there  exists  x,yeSp  with  x?*y  such  that  d(Gx,Gy)= 
d(x,y).  It  follows  from  (27)  that 

d(TF  x,TF  y)  -  d(F  x,F  y)  -  d(x,y)  (28) 

8  8  8  8 

The  lefthand  equality  is  true  if  and  only  if  F  x-F  y  for  nel  .  In  addition, 

O  O 

the  DFTs  of  F  x  and  F  y  are  equal  for  kel_. 

8  8  B 

Define  now  the  sequence  z(n)  by 

z  -  F  x  -  F  y  (29) 

8  8 


The  sequence  z(n)  is  of  length  M  and  its  Fourier  transform  is  zero  over  the 
set  I_  which  contains  M  points.  Thus,  Theorem  4  implies  z(n)*0  for 

D 

0  <_  n  <_  N-l;  and  d(F  x,F  y)  ■  0.  Consequently,  from  (28),  d(x,y)  *  0  which 

8  8 

implies  x*y,  a  contradiction.  Therefore,  G  is  strictly  nonexpanslve, 

d(Gx,Gy)  <  d(x,y)  (30) 

for  all  x,yeSp  when  x^y. 
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Finally,  we  note  that  since  G  is  strictly  nonexpanslve  and  maps  a 
N 

compact  subset  of  R  into  itself,  then  from  Theorem  2  the  sequence  (23) 

converges  to  h(n)  for  any  xfteS  .  Since  the  radius  p  of  the  sphere  S  was 

"  P  P 

N 

arbitrary,  (23)  converges  for  any  Xq£R  . 


4.2  Phase-Only  Iteration 


Recently,  several  sets  of  conditions  have  been  developed  under  which 
a  sequence  is  uniquely  specified,  to  within  a  scale  factor,  by  the  phase  of 
its  Fourier  transform  [6].  One  such  set  of  constraints  is  contained  in  the 
following 


THEOREM  5:  Let  h(n)  be  a  real  sequence  which  is  zero 
outside  the  Interval  [Q,M-1]  with  h(0)^0.  If  the  z- 
transform  of  h(n)  has  no  zeroes  in  reciprocal  pairs  or 
on  the  unit  circle,  then  h(n)  is  uniquely  specified  to 
within  a  scale  factor  by  (M-l)  samples  of  the  phase 
(or  tangent  of  the  phase)  of  its  Fourier  transform  in 
the  open  interval  (0,ir). 

A  special  case  of  this  theorem  arises  when  the  phase  samples  of  H(o>) 
are  equally  spaced  around  the  unit  circle  and  motivates  an  iterative  tech¬ 
nique  for  reconstructing  h(n)  from  these  phase  samples.  Specifically,  we 
have  the  following  Corollary  [6]  to  Theorem  5: 
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Corollary;  Let  h(n)  satisfy  the  constraints  of  Theorem  5 
and  denote  Its  N-point  DFT  by 

H(k)  -  |H(k)|e*p[j0h(k)J  (31) 

with  N  >  2M.  If  x(n)  is  any  sequence  which  is  zero  outside 
the  interval  [0,M-1]  with  an  N-point  DFT  of  the  form 


X(k)  -  |x(k)|exp[J0h(k)  +  j?Tak] 


(32) 


where  ■*  0,+l  for  each  k,  then  x(n)=3h(n)  for  all  n  and  some  scalar  0. 

Motivated  by  this  corollary,  the  following  iterative  technique  has 

been  proposed  for  reconstructing  h(n)  from  0,  (k) : 

n 

-k+i '  Pxk  •  <33> 

where  Fp  -  W  $W  is  the  mapping  defined  in  (11)  and  T  is  the  mapping  (9)  with 
IT  *  {0)u[M,N-l] ,  i,e, , 


T[x(n) ] 


h(0) 

n»0 

x(n) 

0  <  n  <  M 

(34) 

0 

M  <  n  <  N 
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We  now  show  that  the  sequence  (33)  converges  to  h(n)  for  any  x^cR^. 

As  in  (25),  let  Sp  denote  the  closed  sphere  of  radius  p  about  h. 

For  reasons  identical  to  those  in  (26),  we  note  that  since  P  is  nonexpansive 
with  Ph*h,  then  P(Sp)  is  a  compact  subset  of  Sp.  Now  consider  the  mapping 
PtSpC  RN->-RN.  From  (14)  and  (19),  we  recall  that 

d(Px,Py)  =  d(TFpx,TFpy)  <  d(Fpx,Fpy)  <  d(x,y)  (35) 

As  before,  we  show  that  P  is  strictly  nonexpansive  by  contradiction.  Assume 

equality  holds  in  (35)  and  that  x^y.  We  then  have 

d(TFp,TFpy)  -  d(Fpx,Fpy)  =  d(x,y)  (36) 

where  the  lefthand  equality  in  (36)  is  true  if  and  only  if  F  x=F  y  for  nel_. 

P  P  1 

If  we  then  define  a  sequence  z(n)  by 

z  =  F  x  -  F  y  (37) 

P  P 

and  note  that  z(n)*0  for  nel^,  and  that  z(n)  has  an  N-point  DFT  of  the  form 

(32),  it  then  follows  from  the  Corollary  to  Theorem  5  that  z(n)»3h(n)  for 

all  n  and  some  scalar  3.  However,  since  z(0)*0  and  h(0)?*0,  3*0  and  z(n)*0 
for  all  n.  Therefore,  d(Fpx,Fpy)-0  and  from  (36),  it  follows  that  d(x,y)=0 
and  x~y,  a  contradiction.  Consequently,  P  is  strictly  nonexpansive  since 


d(Px,Py)  <  d(x,y) 


(38) 


for  all  x,yeSp  when  xi*y. 

Again,  Theorem  2  guarantees  the  convergence  of  the  sequence  (33)  to 
N 

h(n)  for  any  x^eR  . 

5.0  Extensions 

In  this  section,  we  examine  the  issue  of  convergence  when  the  iterative 
procedures  (21)  and  (22)  are  modified  to  include  a  minimum  or  maximum  value 
constraint  in  the  time  domain.  We  also  briefly  describe  an  adaptive  relax¬ 
ation  technique  which  offers  another  convergent  algorithm. 

5.1  Minimum  and  Maximum  Value  Constraints 

In  some  applications,  the  partial  characterization  of  a  sequence  in  the 
time  domain  includes  a  minimum  or  maximum  value  constraint.  For  example, 
a  positivity  (i.e.,  minimum  value)  constraint  is  frequently  imposed  in  it¬ 
erative  procedures  related  to  Images  [8]  and  spectra  [9]. 

Within  our  framework,  it  is  easy  to  show  that  the  Inclusion  of  a  mini¬ 
mum  or  maximum  value  constraint  into  the  nonexpansive  mapping  T  in  (9)  does 
not  alter  the  nonexpansive  property  of  the  mapping.  Consider,  for  example, 
the  case  in  which  h(n)  is  known  to  be  positive  for  n^I^,  and  let  the  mapping 
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Tq  be  defined  by 


|x(n) |  n^IT 

Tn(x(n))~  (39) 

h(n)  n£lT 

« 

In  this  case,  we  show  that  Tq  is  nonexpansive  as  follows.  Using  the 
triangle  inequality  for  vector  differences,  we  have 

d2(x,y)  >  53  [|x(n)l-|y(n)[]2  =  d2(TQx,T0y)  (AO) 

n^IT 

It  should  be  pointed  out  that  the  replacement  of  x(n)  with  |x(n)|  for  xtl^ 
in  (39)  is  not  the  only  one  which  preserves  the  nonexpansive  property  of  T. 
For  example,  it  is  straightforward  to  show  that  the  mapping 


max[0,x(n)]  ntflT 

T*ntx(n) ]  - 

h(n)  nelT 


(Al) 


is  also  nonexpansive 


A  generalization  of  (39)  and  (41)  to  incorporate  an  arbitrary  minimum 
value  constraint  in  T  also  preserves  the  nonexpanslve  property.  For  ex¬ 
ample,  suppose  that  h(n)  is  known  to  be  greater  than  or  equal  to  some  number 
m  for  all  Then  the  mappings 


Tn[x<n)l-| 


mf|x(n)-m| 

h(n) 


(42) 


and 


T*  [x(n)] 
in 


max[m,x(n)] 

h(n) 


neIT 


(43) 


are  both  nonexpanslve.  This  follows  simply  by  noting  that  Tm  in  (42), 
for  example,  may  be  written  as 


T 

m 


(44) 
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r 


where  T.  Is  the  mapping  (39)  and  where  S  and  S 
u  m  tn 


are  defined  hy 


S  fx(n) ]  -  x(n)-m 

ID 


(45a) 


S~1[x(n) ] 
m 


x(n)+m 


(45b) 


Since  S  and  S  *  are  nonexpansive  mappings,  (44)  Implies  that  T  is  also  non- 
in  m  in 

expansive. 

In  a  similar  fashion,  it  follows  that  if  a  maximum  value  constraint  is 
imposed  in  the  mapping  T,  then  the  nonexpansive  property  of  T  is  preserved. 

In  addition,  by  recalling  that  the  composition  of  nonexpansive  mappings  is 
also  nonexpansive,  we  see  that  an  arbitrary  combination  of  minimum  and  maxi¬ 
mum  value  constraints  may  be  used.  For  example,  if  it  is  known  that 
Mj_<x(n)<M2  for  ntf  1^,  then  the  mapping 


M„ 


[x(n)  ] 


min(M2,max[M1,x(n)]}  n*IT 


h(n) 


nel„ 


(46) 


is  nonexpansive 


mm 


Finally,  we  note  that  if  the  minimum  or  maximum  value  constraints  are 
consistent  with  the  existence  of  a  fixed  point,  the  nonexpansive  property  of 
T  is  preserved  and  the  iterations  (20)  and  (21)  still  converge  to  the  unique 
solution. 

5.2  Fixed  and  Adaptive  Relaxation 

The  motivation  for  examining  convergence  of  the  so-called  under-relaxed 
form  of  the  iteration  given  by  (7)  with  cue (0,1)  is  two-fold.  First,  we  would 
like  to  develop  iterative  procedures  which  converge  in  the  absence  of  a  unique 
solution.  Secondly,  this  iterative  formulation  may  possibly  Increase  the  rate 
of  convergence  of  the  iteration. 

The  iteration  in  (7)  must  converge  if  the  conditions  of  Theorem  3  are 
met.  Theorem  3  also  implies  that  if  a  unique  fixed  point  exists,  the  iter¬ 
ation  will  converge  to  that  solution.  The  iterative  procedures  of  section  4, 
in  particular,  satisfy  the  conditions  of  Theorem  3  and.  In  addition,  have  a 
unique  fixed  point.  Thus,  the  under-relaxed  forms  of  the  Iterations  given  by 
(21)  and  (22)  yield  a  unique  converging  solution.  In  the  case  of  multiple 
solutions,  however,  (7)  will  converge  to  any  one  of  the  possible  solutions. 
Furthermore,  the  minimum  or  maximum  value  constraints  of  the  previous  section 
can  be  Imposed  with  resulting  convergence. 

By  modifying  (7)  slightly,  an  adaptive  form  of  the  relaxation  technique 
has  been  realized.  Specifically,  the  modified  iteration  becomes 

*ien  ■  (1-%)xk +  V*k  (47> 

where  co^  is  a  relaxation  scalar  which  is  computed  at  each  step  of  the  iteration 
and  which  can  be  optimally  chosen  to  minimize  a  residual  error  criterion. 
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For  the  case  where  a  mean-square  error  is  used,  0)^  is  relatively  easy  to 
derive,  and  the  convergence  characteristics  of  (47)  are  significantly  improved 
[13].  Futhermore,  if  the  optimum  relaxation  parameter  is  never  allowed  to 
take  on  values  outside  the  interval  (0,1),  the  convergence  of  (47)  follows 
from  a  modified  version  of  Theorem  3.  A  discussion  of  the  more  general  case 
in  which  no  restriction  is  placed  on  the  range  of  values  for  may  be  found 
in  [14]. 

6 . 0  Summary 

In  this  report,  we  have  demonstrated  the  convergence  of  two  iterative 
procedures  which  involve  repeated  transformations  between  the  time  and 
frequency  domains.  The  convergence  proofs  rely  on  the  nonexpansive  property 
of  the  mapping  which  defines  the  iteration  as  well  as  on  the  uniqueness  of 
the  desired  signal.  The  generality  of  our  approach  is  such  that  other 
iterative  procedures  and  their  under-relaxed  forms  which  are  characterized 
by  nonexpansive  mappings  may  similarly  be  shown  to  converge  when  the  ap¬ 
propriate  conditions  are  satisfied.  For  example,  iterative  deconvolution 
techniques  studied  by  Mersereau  and  Schafer  [9]  and  the  iterative  filtering 
procedure  of  Dudgeon  [15]  fall  within  our  class  of  iterations. 

We  also  considered  the  incorporation  of  a  minimum  or  maximum  value 
constraint  into  the  iteration.  With  our  approach,  the  convergence  of  this 
Iteration  was  easily  demonstrated.  In  a  similar  manner,  other  forms  of 
constraints  may  be  considered  and,  provided  these  constraints  preserve  the 
nonexpansive  property  of  the  mapping,  convergence  of  the  Iteration  follows. 


When  multiple  solutions  exist,  the  under-relaxed  form  of  the  iterations 
has  been  shown  to  converge.  Finally,  we  also  briefly  examined  the  convergence 
of  the  under-relaxed  formulation  when  the  relaxation  parameter  is  variable, 
and  discussed  the  optimal  choice  of  this  parameter  for  increasing  the  rate 
of  convergence. 
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